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SYSraM WITH ENHANCED DISPLAY OF a program in the future can also be quite difficult. The 

DIGITAL VIDEO expense of the additional circuitry in all the devices to 

accomplish these functions is borne by the consumer. 

This application is a continuation of U.S. patent appli- Multimedia based personal computers today are config- 

cation Ser. No. 08/503,119, filed on Jul. 17, 1995, now U.S. S ured with CD Rom drives, and speakers as well as graphics 

Pat. No. 6,359,636 entitled "GRAPHICAL USER INTER- drivers for displaying graphics on a monitor attached to the 

FACE FOR CONTROL OF A HOME ENTERTAINMENT computer. CD Rom drives are capable of both reading data, 

SYSTEM". This application is also related to U.S. Pat. No. such as computer programs, and reading audio information 

5,675,390, issued on Oct. 7, 1997, entitled "HOME ENTER- such as music which is output from the attached speakers. 

TAINMENT SYSTEM COMBINING COMPLEX PRO- 10 Multimedia titles for running on a PC usually are distributed 

CESSOR CAPABILITY WITH A HIGH QUAUTY DIS- ^0°^^ and involve such things as animated encyclo- 

PLAY" and U.S. patent appHcation Ser. No. 09/129,449, pedias and other books, as well as games that may incor- 

filed on even date herewith, entitled "ASYSTEMPROVID- po^ate video cUps which can be shown on a PC display. 

ING DATA QUALITY DISPLAY OF DIGITAL VIDEO". More and more of the video information on such CDs is 

15 compressed in accordance with Motion Picture Experts 

FIELD OF THE INVENTION Group (MPEG) standards and requires commercially avail- 
able software or circuitry to decompress it and process it for 

present invention relates to an mterface for a multiple user ^ . ^^^^^ ^^^^^^ typically of VGA quality, 

home entertainment system, and m particular to the user g^^^ ^^^^^^ p^^ ^ven provide a connection to 

interface for controlUng operation of the system. ^.^^^ ^^^^^ ^^^^ ^^^^^^^ ^^^^^^ pj^y.^ ^ ^ ^^^^^ 

BACKGROUND OF THE INVENTION «° '^A'.^^'^^^i'.^^^ ?Tk' ' ^'^^^^ 

graphics adapter (VGA or SVGA) card which processes all 

The consumer electronics industry has created many stand the information to be displayed on a monitor and the monitor 
alone products for specific functions, such as television itself is basically a picture tube that shows only what it is 
viewing, video recording and playback, broadband video 25 sent with very little processing. However, most PC displays 
receivers, playing recorded music and broadcast music. are small, and not suitable for viewing by multiple people at 
Some devices combine functions, such as the combination the same time. It often happens that when a family gets a 
TVA^CR, and the audio cassette/AM/FM receiver to name new program such as a game, animated book or educational 
a couple. One direction that consumers are moving is toward game, everyone wants to see it being used for the first time, 
larger televisions located within a family room or living 30 and they huddle around a small display and vie for positions, 
room with accompanying high quality stereo. Multiple com- In addition, there is no good way for multiple users to 
ponents are required, each providing separate functions. A interact on a single computer. For viewing video feeds from 
large screen television based on a 19 inch to 40 inch picture cable or satellite, large screen consumer television sets are 
tube, or 46 inch to 60 inch projection system is used and most commonly used in the home entertainment center, 
viewed from a distance of two to five meters. The television 35 As can be seen, there is great duplication of function 
includes a tuner for receiving and decoding National Tele- between the consumer electronics and personal computers, 
vision Systems Committee (NTSC) signals, infrared both of which are more and more likely to be found in a 
receiver circuitry for a remote control, and in many cases family room or great room of a home. This duplication of 
stereo and surround sound integrated into it, making it a very function leads to much more money being spent to fully 
expensive device. Further, the consumer likely has a video 40 outfit the home entertainment center and provide additional 
recorder/player, and perhaps a cable box/set top box to functions. When one component fails, since it has duplicate 
receive cable or satellite transmission which may also function, it is expensive to replace. One system that tried to 
include a video tuner and other electronics to handle solvesomeof the above problems is shown in U.S. Pat. No. 
modulated, compressed and encrypted video signals. In 5,192,999 to Graczyk et al. That system has a television 
addition, a consumer is also likely to have a separate stereo 45 circuit and an audio circuit within a personal computer, both 
system complete with CD player, tuner and other audio of which are controlled by a remote control device. The 
attachments, such as speakers. This duplicates much of the television circuit is used to receive common cable or broad- 
functionality of the television system and adds to the cost of cast video signals in NTSC format, which inherently have a 
a home entertainment center. lower quality than video signals currently broadcast by 

Most consumer electronic devices come with remote so digital broadcasting satellite. NTSC format signals are 
control devices, which as in the case of the television above, interlaced, which means that every other line is refreshed 
require sensing circuitry to receive and process the signals during each scan of the picture tube. For example, odd lines 
from the remotes. Such controls are typically based on IR would be refreshed during a first scan, and even lines during 
signals which can be interrupted by someone walking in a second scan. Since there are 60 scans per second, odd lines 
front of it, and are not able to be used in a different room ss are refreshed 30 times per second, and even lines are 
from the receiver. While a few have on-screen programming refreshed 30 times per second. VGA monitors refresh at least 
functions, and there are special remote control devices 60 times per second, providing a more coherent spacial and 
which can be programmed to control multiple consumer temporal image. The NTSC signal is a lower bandwidth 
electronic devices found in a home entertainment center, signal than digital MPEG, which has a much higher band- 
there is little consistency between such controls. In addition, 60 width and allows productive use of even higher resolution 
there is no good way to use different remote control units to monitors. While Graczyk et al. does convert the NTSC 
control different programs generating the information dis- signals to VGA format for display by a data quality analog 
played in various windows on the screen. This leads to monitor, the signal quality is limited because of the lower 
confusion of the consumer, and the classic case of the bandwidth transmission. OTSC signals have a great effect on 
blinking "12:00" as consumers become fiustrated trying to 65 the type of text that can be displayed. With an interlaced 
master all the protocols required to appropriately control display, the text displayed in normal fonts appears to jump 
their electronic devices. Trying to program a VCR to record as alternate lines are refreshed. There have been several 
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attempts to design fonts that minimize this jiimp effect, but In one embodiment, all the elements except the monitor 

none have worked well. A VGA display, refreshing each line are contained within a personal computer chassis, and the 

with every scan of the tube, does not have this problem, and monitor does not contain a tuner. In a further embodiment, 

provides a much sharper and readable image for text. all the above elements are contained within a monitor 

The monitor described by Graczyk is shown as a standard 5 chassis. The digital video signal is then displayed on the 

PC analog VGA monitor, and reference is commonly made monitor without cropping, 

to a single user. Such monitors are fairly small, having a Also a multipurpose computer system is provided with 

maximum viewing area of 17.5 inches (44.5 cm) at the high circuitry to control consumer electronics, such as a large 

end of the PC market. They are not nearly suitable for monitor or television for group interaction and of text, 

viewing in a home entertainment environment. They are graphics and video in a home entertainment environment, 

designed for close viewing, having pixels very close The circuitry provides audio and video tuning capability for 

together. Current home entertainment systems arc much display of received high quality video signals on the monitor 

larger aiid expensive due to all the other circuitry they have without an intermediate conversion to a lower quality NTSC 

as described above. format. The circuitry decodes the received video signals and 

One satellite broadcast system is that provided by converts them to VGA format which provides images of 

DirecTV, a unit of GM Hughes Electronics. Direct Broad- higher quality than NTSC. The monitor is capable of directly 

cast Satellites, "DBS" provide more than 150 channels of displaying VGA signals, and is not required to have a 

high-quality MPEG based video sound and data to 18 inch television tuner circuit, remote control, or audio circuitry, 

45.7 cm) receiving antennas Rights to make subscriber significantly reduces the cost of the monitor and 

termmals are hcensed by DirectTV, and several other com- ^- ^ ^ ^ -^^ ^ 

panics contributmg technology. News Datacom Corporation ^ ^ , , ? v . . ^ ^ . •'^ . * 

^ J % r *u T>.i:ic . screen televisions which contain complex tuning Circuitry, 

provides encryption and secunty for the DBS system, pro- f e> j 

viding decryption keys, software and an access card for each o^c embodament, the high quality video signals arc 

subscriber terminal. Thomson Consumer Electronics pro- received from satellites broadcastmg digital video signals, 

vides consumer subscriber terminals in the form of set top digital cable signals and other wireless digital broadcasts, 

boxes called integrated receiver/decoders "IRDs" which 25 One example is direct broadcasting satellite "DBS" signals 

convert the high-quahty television signals into NTSC for having a quality ofvideo signal higher than that provided by 

showing on a standard television. Each IRD demodulates, NTSC broadcasts. The DBS signals are MPEG-compressed 

decodes, decrypts and outputs video and data, which is video, audio and data. The DBS signals are received by a 

displayed on a subscriber television. Error correction, video receiver circuit board which is compatible with a 

decompression and demultiplexing to separate out video 30 standard personal computer peripheral component intercon- 

data from other data is also provided in the IRD. While S nect (PCI) bus and fits within the chassis of a personal 

Video output is provided, there is no provision for monitor/ computer. The video receiver cards have panel connectors 

VGA quality output capability. Other sources of MPEG for receiving coax cable from an antenna which directly 

based video include optical fiber based cable systems, com- receives the DBS signals. The card has functional blocks 

pact disk, video cUps available on the Internet network, both 35 comprising a satellite tuner, digital demodulator, forward 

old and proposed HDCD (high-definition compact disk) error correction, conditional access and decryption/ 

formats, and other existing and proposed satellite, digital demultiplexing. The demultiplexer provides the capability 

cable, and asynchronous-transfer mode (*'ArM")-bascd sys- of receiving data packets which range from information on 

tems as well as wireless digital broadcasts. television programs being broadcast, to computer programs 

« , . r™,^ ,.^^*™^.r 40 ^OT dowuloading into computer memory. 

SUMMARY OF THE INVENTION ^ • a , . a '\ ^ -a a- a 

The video receiver card outputs digital video, audio and 

An electronic card for a system has a receiver that data streams onto the peripheral component interconnect 

receives an encoded digital video signal from a source "PCI" bus where it can be accessed by the computer main 

external to the system. A decoder is coupled to the receiver processor for manipulation and storage. When stored in a 

and receives the encoded digital video signal from the 45 personal computer memory, the program information may 

receiver. The decoder decodes the signal into a decoded be organized in a commercially available database format, 

digital video signal. A video driver is coupled to the decoder This permits the use of database functions to be applied to 

and converts the decoded video signal into an analog signal the data. Rather than being stuck viewing the program 

suitable for display on a data quality monitor information as provided by the broadcaster, the data imme- 

In one embodiment, the electronic card is a video card for 50 diately becomes manipulable by database commands, allow- 

a PCI bus of a personal computer or home entertainment ing queries of program information. Searches are used to 

system having a monitor with a resolution of at least 640 by show programs having certain actors or subject matter, and 

480 pixels. The encoded or compressed digital video signals even have programs meeting the query automatically 

are broadcast signals, such as by satteUte, and are encoded recorded. One use entails a user designating a series to be 

in accordance with MPEG standards. The decoder com- 55 recorded, and the database keeps track of what has been 

prises an MPEG decoding circuit. recorded or already viewed, avoiding duplicate recording, as 

An audio processing circuit is coupled to the converter for well as providing easy access to the recorded programs. In 

receiving decompressed audio data encoded in the digital general, by capturing data along with video and audio in a 

video signal and provides an output suitable for driving form which a personal computer can process, the possibili- 

speakers. The audio may also be received from a micro- 60 ties for computer applications are endless. Interaction with 

phone or audio CD player, and the audio processing circuit movies, classrooms, other players of games such as golf and 

may comprise an FM synthesis circuit that synthesizes a host of other possibilities becomes clear, 

sound. Further embodiments of the system include a settop box 

A data quality monitor that receives the data quality version, where all the circuitry is integrated into one or two 

analog signal and displays video images therein may also be 65 cards in a box designed to sit on top of a television set having 

included with the system having a resolution of at least 640 VGA input. In another version, all the circuitry is included 

by 480 pixels. inside of the television chassis. 
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In one embodiment of the invention, closed caption 
information provided in video signals is captured, and stored 
in the database for searching. This provides the ability to 
instantly find current programming discussing events that a 
user is interested in. In a further embodiment, speech 
recognition circuitry is used to convert speech to text or 
commands for similar searching capability. Given current 
speech recognition capabilities, not all words may be rec- 
ognized. Only those that are recognized are stored in the 
database or used as a command. Much of the information so 
captured is not relevant in a certain amount of time, so a data 
retention mechanism is used to identify old data and delete 
it from the database once the database has exceeded its 
allocated resource level. A standard FIFO algorithm based 
on the time expired since the programs described have been 
shown is employed. Further algorithms are user selectable to 
relevancy rank data in accordance with user preference. 

A video graphics adapter (VGA) card also coupled to the 
PCI bus converts the digital data stream into VGA and video 
signals for display on the monitor. In addition to being a 
home entertainment system, a fully functional computer 
system forms the heart of the entertainment system. Instead 
of buying all the individual consumer electronics parts, such 
as a large screen television, settop box for receiving broad- 
band video, audio amphfier/receiver, CD player, universal 
remote control, video game machine, answering machine 
and fax, and a personal computer as some consumers do 
today, they need only buy the home entertainment system of 
the present invention. The cost is about the same as that for 
the individual traditional consumer electronics parts, making 
the personal computer essentially free. 

Support for remote control of both the personal computer 
and the monitor functions is also provided in the personal 
computer as well as standard PC VGA graphic display 
functions normally associated with personal computers. 
Additional functions also become available based on the 
integration of devices and digitized data, video and audio. In 
this manner, no audio, remote control or channel tuning 
electronics is required in the display, which results in a much 
lower price for a large monitor suitable for home entertain- 40 
ment. Both a handheld remote control having standard 
television and in one embodiment, video cassette recorder 
controls, and a full function remote keyboard having similar 
standard television and video cassette recorder controls are 
provided. Both transmit key signals identifying the key 45 
pressed, as well as a signal identifying the source of the key 
signal. The key signals are preferably RF signals typically in 
the megahertz range, but can also be IR or other suitable 
form of radiation. RF signals have the advantage over 
infrared "IR" signals in that they are not interrupted by 
someone walking between the remote and the receiver. Light 
source interference and jamming of other IR receivers is 
minimized by using RF signals. It may also be used in a 
different room from the receiver. 

The personal computer contains suitable receiving 
circuitry, which provides indications of the keys being 
pressed, with the identity of the remote control device 
sending the signal. In one embodiment, an industry standard 
architecture (ISA) board or module is plugged into both the 
keyboard and mouse ports. Another bus, such as a serial, 
RS232 or microchannel bus may also be used. The board 
contains RF receiver circuitry which receives the RF signals, 
decodes them and routes them to the appropriate port for 
processing. A receiving module is programmed to distin- 
guish between the sources of the remote control transmitted 
signals, and directs keystrokes to the keyboard port, and 
mouse movements to the mouse port. The signals at the two 
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ports then conU-oI which program the remote key signals 
affect. If the handheld remote is activated, the key signals 
usually would control what channel is being displayed, or 
cause a recorded program to fast forward, play or reverse. It 
could however be selected to move to the next image or 
otherwise control a program designed to display pictures 
taken on a digital camera. Keyboard keys are more likely to 
control a computer program application such as a word 
processor, spread sheet or electronic mail program. In one 
embodiment, the television like controls arc used to oveaide 
the remote hand held television controls in channel selec- 
tion. Just as easily, the hand held remote controls paging 
through electronic mail. Additionally, the hand held remote 
has a pointing device, such as a trackball, or miniature 
joystick with normally associated keys for selecting func- 
tions identified by the cursor on the display being moved by 
the pointing device. The keyboard contains an integrated 
louchpad for performing similar function, and additionally 
for transmitting signatures, providing the ability to ensure 
that an authorized user is requesting a transaction. Given the 
entertainment room environment, a touchpad provides the 
further benefit of being able to withstand greasy popcorn and 
chicken fingers which might foul other pointing devices. In 
a further embodiment, each remote control device has its 
own unique cursor associated with it. In this manner, it is 
easier for the user of a particular device to know which 
program wiU be affected when the remote is used. 

The remote controls arc also used to control the data 
supplied to more than one display. In one embodiment, a 
display is located in a den, where it is displaying a financial 
application, such as a checkbook balancing program. The 
personal computer is set up to drive multiple monitors, and 
the remote control keyboard is assigned to the monitor in the 
den to control the running and display of information from 
the financial application. 

The remote control devices are used to control one or 
more ciu:sors displayed on the monitor as part of a graphical 
user interface into the home entertainment system. Cells 
displayed as boxes containing descriptive text are associated 
with video programs and with video programs and with 
computer programs, may be selected to view and/or run the 
programs. Several icons, such as pictures, video clips or list 
boxes indicating functions, like record are used to provide 
functions by dragging and dropping cells onto the icons. 
Other icons include remind, buy, picture in picture and view 
full screen to name a few. In one embodiment, each remote 
control controls its own cursor to allow multiple users to 
control different portions of the system. 

In a farther preferred embodiment, the remote control 
devices are equipped with a user mechanism to reduce the 
power of the transmitted radio frequency signals depending 
on their distance from the computer. Circuitry is provided to 
detect the power level of the signal received and provide an 
indication on the computer screen, or transmit power level 
signals back to the remote control device indicative of the 
power level of the signal received. The remote control 
device has means to adjust the power, either by the user 
varying the resistance of the power amplifier, or by digital 
adjustment of the power amplifier based on the power level 
signals transmitted from the computer. The ability to control 
the power level of the signals helps lengthen the time 
required between replacing batteries which power the 
remotes. 

In yet a further embodiment, remote earphones are pro- 
vided. The personal computer has the capability to generate 
separate sound tracks for each window being displayed on 
the monitor. It assigns each to one or more sets of earphones 
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and transmits a local FM signal or broadcast IR or RF which ings which form a part hereof, and in which is shown by way 

is received and played by the earphones set to the right of illustration specific preferred embodiments in which the 

channel. The earphones have tuning circuitry that allows invention may be practiced. These embodiments are 

them to be set to a desired channel, or they may be fixed to described in sufficient detail to enable those skilled in the art 

different frequencies, and software is used to set the fre- 5 to practice the invention, and it is to be understood that other 

qucncy or frequencies on which the audio associated with a embodiments may be utilized and that structural, logical and 

window is broadcast. electrical changes may be made without departing from the 

spirit and scope of the present inventions. The following 

DESCRIPTION OF THE DRAWINGS detailed description is, therefore, not to be taken in a limiting 

jQ sense, and the scope of the present inventions is defined only 

is a block diagram of a home entertainment system j^y appended claims 
for processing and displaying high quality video in accor- Numbering in the Figures is usually done with the hun- 

dance with the present mvenuon. ^^^^ thousands digits corresponding to the figure 

FIG. 2 is a top view representation of the end of a shell number, with the exception that the same components may 

connector for coupling to a monitor in accordance with the appear in multiple figures. Signals and connections may be 

present invention. referred to by the same number or label, and the actual 

FIG. 3 is a block diagram showing major components of meaning should be clear from the context of use. 
a personal computer in the home entertainment system of In FIG. 1, a home entertainment system is shown gener- 

FIG. 1. aUy at 110. Extemal to the home entertainment system, a 

FIG. 4 is a block diagram of a tuning circuit in the 20 satellite 112, which in one preferred embodiment is a HS601 

personal computer of FIG. 3. model, operated by Hughes at a 101 degree west longitude 

FIG. 5 is a block diagram of a video graphics adapter in geosynchronous orbital location transmits signals compris- 
the personal computer of FIG. 3. channels of modulated digital video, audio and data 

T^/^^ uiij- r J- j 1 signals at a frequency of about 12 GHz. The satellite signals 

FIG. 0 IS a block diagram of an audio card in the personal ^ • j u *u 1 • 11 n if., ™ 

f f Fir ^ 25 arc received by the home entertamment system 110 by an 

compu r o . . antenna 114 containing a low noise block converter ampli- 

FTG. 7 is a block diagram showing input and output -j^^ antenna is preferably about 18 inches in diameter 

connectors which are provided m the personal computer of ^nd receives left and right hand circularly polarized signals 

^- between 12.2 and 12,7 Ghz. The antenna provides a 

FIG. 8 is a block functional diagram showing the func- 30 "downconverted-spectrum" signal between 950 and 1450 

tional elements of a database storing programming informa- MHz via a coaxial cable or other suitable communication 

tion which can be displayed on the system of FIG. 1. medium 116 to a system device 118, such as a personal 

. FIG. 9fl is a top view of a hand held remote control device computer or other system or circuitry capable of processing 

in one embodiment of the present invention. data. Suitable antennas are already being manufactured and 

FIG. 9b is a cut away side view of a hand held remote ^5 sold by RCA Corporation by direct sales and through 

control device in one embodiment of the present invention. numerous major retail chains such as Radio Shack. The 

, -J - r 1. . i.jLij system 118 contains circuitry and software to further pro- 

FIG. 9cis a cut away side view of an alternative hand held ^i. • 1 r ^ n j j 1 

... .r.u . cesses the signals from the antenna, generally demodulating 

toSor embodmcDt of the present ^^^^^^ ^.^^ ^^^^ a VGAs^nal. The VGA 

40 signal is provided via a standard VGA compatible monitor 

HG. 10 is a top view of a keyboard remote control device ^able 120 to drive a large screen data quality monitor 122 

in one embodiment of the present invention. suitable for viewing in a family room or entertainment type 

FIG. lla la is a high level flow diagram showing how room environment. The system 118 provides for user input 

commands from the remote controls of FIGS. 9a~c and 10 by means of remote controls 124 and 126. Remote control 

are processed. 45 124 comprises a handheld size device with standard televi- 

FIG. life is a high level block diagram showing the sion controls and numeric keypad, and in one embodiment, 

association of remote control devices to appKcations. VCR controls and a pointing device. It provides RF (radio - 

nG. 12 is a block diagram showing power adjustment frequency) or IR (infrared) control signals received by the 

controls for the remote control devices of FIGS. 9a-< and system 118. Remote control 126 is a frill fimction personal 

2Q 50 computer keyboard, with additional standard television and 

1^- ^- , .11,. ^ ^- r VCR controls, pointing device which is preferably in the 

HG. 13 IS a block diagram representaUon of a user ^^^^ ^ ^ .^^^ ^^^^^^ 1^ 

mterface displayed on the screen of the present invention. ^^^^^^ ^^^^^^ ^.^^^ ^^^^ ^^^^^^^ ^^^^ 

HGS. Ua-f are block diagram representations of a user qj. hardwired in one embodiment due to the home entertain- 

interface for interacting with the home entertainment system ^^^^ environment. It allows the system to be in a different 

of the present invention. j-oojn from the monitor 122, or if in the same room, a clear 

FIG. 15 is a block diagram representation of a video- line of sight is not required. In another embodiment, IR 

conferencing system based on the home entertainment sys- control signals were selected because of the availability of 

tem of the present invention. many standard circuitry at low cost. Further detail of the 

FIG. 16 is a block diagram representation of an alternative 60 remote control devices is provided below, 
video conferencing system based on the home entertainment The monitor cable 120 is a standard type cable typically 

system of the present invention. used on VGA display devices, and comprises up to fifteen 

electrical conductors, interfacing with the monitor 122 in a 

DESCRIPTION OF THE PREFERRED ^ ^^^^^^ ^^^^^ connector indicated at 210 in FIG. 2. llie 

EMBODIMEl^rr gfj^gjj jg^jg^ gQjjjg ^j^^^ ^^^y^ gjj^j p-jjg jjjg 

In the following detailed description of the preferred connector which is a molded over, shielded, triple row, 15 

embodiment, reference is made to the accompanying draw- position, subminiature D, straight male plug. The leads are 
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labelled and identified in a table indicated generally at 212 of the remote control device sending the signal. RF receiver 

next to the representation of shell connector ,210. The 324 comprises an ISA board or module plugged into both 

monitor contains a suitable female connector for receiving standard keyboard and mouse ports. The board contains RF 

the male shell connector 210. receiver circuitry which receives the RF signals, decodes 

The monitor 122 in FIG. 1 is preferably capable of s them and routes them to the appropriate port for processing. 

displayingatleastVGAquality data and video. At least 640 A system controller program running on processor 310 

by 480 pixels of resolution are displayable on the monitor. supervises software drivers which are programmed to dis- 

Altemalive monitors of higher quality, such as SVGA pro- tinguish between the sources, and control which program the 

viding an even greater number of pixels are also used in a remote key signals affect. If the handheld remote is 

further embodiment. Many common graphics cards support activated, the key signals usually would control what chan- 

multiple such formats, providing great flexibility. The tube nel is being displayed, or cause a recorded program to fast 

size is 33 inches with a diagonal viewing size of 31 inches. forward, play or reverse. It could however be selected to 

An alternative tube size of 29 inches with 27 inch viewing move to the next image in a program designed to display 

area is lower cost and more suitable for an entry model pictures taken on a digital camera. Keyboard keys are more 

entertainment system. Monitor 122 preferably contains an -j^ likely to control a computer program appUcation such as a 

analog tube with an aspect ratio of 4 by 3, supports VGA word processor, spread sheet or electronic mail program, 

input, has a dot pitch of approximately 0.8 to 0.95 millime- However, the television like controls might be used to 

ters for the 33 inch tube and 0.65 to 0.8 millimeters for the override the remote hand held television controls in channel 

29 inch tube with a misconvergence of 1 to 1.5 millimeters, selection. 

a bandwidth of 15 Mhz, a brightness of about 33 FL. One Further elements of the preferred embodiment of the 

CRT which may be used is manufacmred by Mitsubishi, present invention include a tape drive 330 for backup of data 

having a model and type number of M79KKZ111 X. The and storage of video information, such as a movie or other 

above specifications may easily be modified for larger tube program, a fixed disk drive 332 for storing programs and 

sizes, but are designed to provide optimal viewability from data, a CD ROM drive 334, and a diskette drive 336, all as 

a distance of less than two to about four meters for a ^5 commonly known in the personal computer art. A pair of 

combination of data and high quality video. If the viewing speakers 338 and 340 are also provided. A power supply and 

distance is desired to be less, the tube size and dot pitch associated control circuitry is indicated at 342, and is 

should be decreased. If the tube size is not decreased, more coupled to the RF receiver 324 to receive signals represen- 

pixels would need to be displayed for adequate viewing of tative of power on and power oK commands from the remote 

data. SVGA monitors providing more lines would be more 30 control devices. Power circuitry 342 maintains power to the 

appropriate. Standard digital monitor controls to control RF receiver 324 even when the rest of the system is shut 

brightness, contrast, vertical and horizontal sizing and down to ensure that the power on signal is received and 

positioning, on/off (rest/resume) are also provided, with both executed. To avoid accidental powering off of the system, 

a user accessible manual control panel, and circuitry for two consecutive power off signals must be received before 

receiving control information from personal computer 18 in 35 the system is powered down. 

via monitor cable 120. Further embodiments of monitor 22 one preferred embodiment, processor 310 is a 100 mhz 

include larger displays of 35 and 40 inches viewable and Pentium processor, RAM 314 comprises a minimum of 16 

LCD large projection screen type displays. Both aspect megabytes, disk drive 332 is a 1 .5 gigabyte IDE hard drive, 

ratios of 4:3 and 16:9, commonly referred to as wide screen the CD ROM drive 334 is a quad speed, 3 disc changer, and 

are supported. 4q the fax/modem is a standard 28.8 k bits-per-second (or 

Further detail of the functional blocks of system 118 are "KBAUD") modem. It should be noted that components in 

shown in FIG. 3. A processor 310 resides on a system board personal computers are getting faster, smaller and cheaper 

containing an industry standard PCI bus 312. A random with higher capacity. It is easily anticipated that larger 

access memory 314 is coupled to both the processor 310 for memories and faster modems and processors will be pref- 

direct access, and to the PCI bus 312 for direct access by 45 erable over the next 20 plus years. In an alternative preferred 

other components also coupled to the PCI bus 312. embodiment, a very high speed processor 310 is used, and 

The other components comprise a receiver 316, video receiver 316 simply comprises circuitry to transform 

graphics adapter, VGA converter card 318, sound card 320 received signals into a digital format. The remainder of the 

and modem 322. An RF receiver 324 is coupled to standard functions of the receiver 316 and VGA card 318 are per- 

keyboard and mouse ports, which in turn are coupled 50 formed by software routines to receive, tune multiple simul- 

through a standard keyboard/mouse adapter to an ISA bus taneous channels, decompress, perform error checking and 

326 to processor 310. Both keyboard 126 and handheld correction and convert the digital signals into digital VGA 

remote 124 transmit RF signals identifying the key pressed, format. The VGA card 318 in this embodiment simply 

as well as a signal identifying the source of the key signal. comprises a digital to analog converter. 

The RF signals are typically in the megahertz range, but can 55 Receiver 316 is shown in further detail in FIG. 4. A tuner 

also be IR or other suitable form of radiation. RF signals 410 receives the direct broadcast signal from antenna 114 

have the advantage over infrared "IR" signals in that they are via standard coaxial cable 116. The broadcast signal is 150 

not interrupted by someone walking between the remote and channels of high-quality television, including data, com- 

the receiver. This is especially important during a drag and pressed in accordance with motion picture expert group, 

drop type of activity. If the signal is interrupted for example, eo MPEG-1 standards with MPEG-2 expected to be available 

a needed document might be dropped on a trash can icon, in the near future. The information is carried on an approxi- 

causing the document to be unintentionally deleted. Light mately 12 gigahertz carrier, and the receiver 316 selects 

sotjrce interference and jamming of other IR receivers is channels from the carrier and performs analog to digital 

minimized by using RF signals. It may also be used in a conversion of the signal. A demodulator 412 is coupled to 

different room from the receiver. 65 tuner 410 for demodulation of the digital signals. Forward 

RF receiver 324 receives the RF signals, which provide error correction is provided via standard Viterbi and Reed- 
indications of the keys being pressed along with the identity Solomon algorithms at block 414. The output of block 414 
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comprises an encrypted digital signal, in one embodiment pressor chip which performs the decompression. DRAM 

encrypted in accordance with data encryption standards 514 is used as a buffer to assist in the decoding, since large 

"DES." While it is not important to precisely reproduce the amounts of data are required at one time to decode MPEG 

video signal, it is much more important to get the data such data. Audio information from the decoded MPEG data is 

as computer programs and financial information accurately. 5 provided to a header 516 for transmission to the sound card 

The above error correction algorithms are designed to 320, The decoded video signal in YUV color encoding is 

reduce the error rate for data to 10*^^ errors per byte of data. provided back to controller 510 which then places the video 

For video and audio, an error rate of 10"® is acceptable. The information into a dynamic random access memory or video 

error corrected encrypted digital signal is supplied to a random access memory, VRAM 518. A converter 520 

decryption and demultiplexing block 416, Block 416 is retrieves the information from VRAM 518 and generates 

coupled to a conditional access card 418 which provides the standard analog VGA display signals on a cable adapter 522 

key for decrypting the digital signal. Upon separating the which mates with shell 210 in FIG. 2 for display, 

multiplexed digital decrypted signal, it is provided as digital Other audio video inputs are provided on VGA card 318, 

MPEG conforming signals via a connector 420 to PCI bus including a standard cable connector at 524 coupled to a 

312. video tuner circuit 526. 'Ibner 526 provides both an audio 

In operation, when processor 310 executes a command, output on line 528 to header 516, and an audio video signal 

such as changing a channel, it sends the command over the to a video decoder 530 via line 532. Line 532 is also coupled 

PCI bus 312 to receiver 316, where tuner 410 tunes in a to a video multiplexer 540, which selects one of at least two 

different channel, and the video signals are processed and NTSC compatible audio video signals it receives to an audio 

sent on to VGA card 318 and sound card 320. Once on PCI 20 video out panel connector 542, Video decoder 530 also 

bus 312, the digital MPEG signal may follow several receives audio video inputs from further panel connectors, 

different courses. In one embodiment, a buffer is allocated comprising RCA jack 544, S-video pin 546 and a second 

from RAM 314 to hold a user selected amount of com- RCA jack 548. The video signals provided on these lines are 

pressed video data or information comprising computer decoded by decoder 530 into YUV video output on line 550, 

programs. The same buffer concept may be applied to disk 25 which also receives decoded MPEG signals from decoder 

drive 332, which is useful for holding an even larger amotmt 512. Both these signals are available for display by VGA 

of information. Tape drive 330 is preferably an 8 millimeter display via controller 510 without conversion to NTSC. An 

tape device, and is useful for storing entire programs of data alternative is to route the signals on line 550 to a YUV to 

or MPEG compressed video/audio information. The NTSC converter 552, which feeds video multiplexer 540 for 

tradeoffis for each storage device are clear, with the cost of 30 display on a standard television of NTSC signals. However, 

storage per megabyte increasing with the speed with which conversion to NTSC results in an inferior picture being 

it may be retrieved. Hence, while RAM provides very fast generated from what is received in either S-video or from the 

access, it is a limited resource, and does not make sense to antenna 114 as represented by the MPEG signals on PCI bus 

use for much more then a few seconds of video related data. 312. By not converting to NTSC, the entire transmitted 

Also, it is a transitory memory in that it does not persist if 35 image may be displayed. Prior art NTSC conversion lead to 

power is removed. It is most useful for buffering about 10 a cropping of the image to ensure that the image presented 

seconds worth of video information. While it is not possible was not degraded at the edges. The present invention pro- 

to predict how long a block of data will play when convert- vides the abiHty to scale for provision of the entire trans- 

ing to video, 10 seconds is about 15 megabytes of data. The mitted image without quality loss at the edges, since it 

tape drive 330 is the cheapest fonm of data storage, but is not 40 provides a digital video signal. No overscan is required as is 

randomly accessible. In other words, it can take some time needed to ensure smooth display borders for NTSC analog 

for the tape to move to the right place before desired data can transmissions. 

be retrieved for playing. However, it does provide the most Sound card 320 is shown in further detail in the functional 

cost effective storage for linear playback of movies and block diagram of FIG. 6. Both FM synthesis and wavetable 

television shows. A disk drive 332 is has an average access 45 synthesis are provided at 610 and 612 respectively. Their 

time of about 10 milliseconds, making it a nice tradeoff outputs are mixed or multiplexed at 614 and provided to a 

between tape and RAM for buffering portions of video mixer and coder/decoder 616 which provides a line out 618 

information and allowing the user to select and quickly play containing SoundBlaster compatible output for connection 

back desired buffered video. It, like tape is also persistent. to standard speakers if desired. In a further embodiment. 

When the MPEG data is buffered, a FIFO type of buffer 50 surround sound compatible output is provided. Mixer 616 

is used, with new information written over the oldest infor- also has a microphone input line 620, a CD audio digital line 

mation when the buffer is faU. Through use of the television in 622 one embodiment, and a CD audio analog line in 624. 

and VCR remote controls on handheld remote 124 and A multiplexer 626 also multiplexes multiple input lines into 

keyboard 126, VCR-like instant replay functions are pro- mixer 616. Aline in 628 and two audio/video lines 630 and 

vidcd from the buffered MPEG data. The buffered data is 55 632 are multiplexed by multiplexer 626, as are signals 

sent back under processor 310 control via the PCI bus 312 received from header 516 via lines 634 and 636. Line 634 is 

to the VGA card 318 for display on monitor 122. coupled through header 516 to tuner 526, providing an audio 

The VGA card 318 is now described with reference to signal from channels on cable connector 524. Header 516 is 

FIG. 5. In FIG. 5, a controller 510 is coupled to the PCI bus also coupled to MPEG decoder 512 to provide MPEG PCM 

to receive MPEG encoded video, and other normal personal 60 (pulse-code modulation) audio through digital to analog 

computer display information such as graphics and text. If converter 640 to line 636. Lines 636 and 634 are also 

controller 510 detects MPEG data on PCI bus 312, it routes coupled through a further multiplexer 642 to provide a line 

it to a decoder 512 with associated dynamic random access out of VCR compatible audio on a line 644. 

memory of 2 megabytes, DRAM 514. Decoder 512 decodes FIG; 7 shows multiple ports available on the back panel 

the MPEG data in accordance with MPEG standards. A 65 of the personal computer 118, and on the cards shown in 

commercially available chip from SGS-Thompson FIGS. 4, 5 and 6. The back panel connections are shown 

Microelectronics, part number STi3520 is one such decom- generally at 710. The audio video inputs comprise RCA jack 
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544 and audio left and right speaker connectors 630 for words that are recognized are fed into yet another partition 
receiving audio video input from a VCR or game machine, of the database which can be independently searched. 
S-video pin 546 and auxiliary RCA jack 548 for receiving Various views of the hand held remote control 124 are 
audio video input from a VCR, camcorder or laserdisc and shown in FIGS. 9ti, 9fc, and 9c. A 19 millimeter optical 
left and right audio connectors 712. Audio video out con- s trackball 910 is integrated into the remote, and functions just 
nectors 542 and 644 are available on the back panel 710 for as any other pointing device for personal computers, gen- 
coupling to a VCR for recording. Sound card 320 contains crating cursor control signals that are transmitted to the 
connectors 618, 620 and 628 on the mounting bracket, plus personal computer 118. In a further preferred embodiment, 
a game port 720. VGA card 318 contains the coaxial cable the cursor control device is a miniature joystick shown at 
connection 524 and the VGA output port 522. Digital lo 911 in HG. 9C, that is operated by a finger being placed on 
receiver card 316 contains the coaxial cable connector to ^^p of the stick and pushmg m the direction of desired cursor 
coaxial cable 116, and a slot for the conditional access card movement. Selection buttons, or mouse clickers are pro- 
418 indicated at 720. Slot 720 may be a standard PCM/CIA ^^^ed at 912 for the user to press to select functions on the 
slot (also referred to as CardBus or PC Card), or any other personal computer that the cursor is touching. An addiUonal 
type of connector desired, such as one specified by News is selection button is provided at 913, which is 
Datacom, who is providing such digital sateUite system convenient for use by an index finger if holding and pomtmg 
(DSS) cards for settop boxes. By providing the above the remote m a natural posiUon. It is also useful as a pseudo 
connectors and ports on the back side of the personal tagger for many games, and for one handed dragging and 
computer, they are accessible for easy wiring, but also out of dropping of icons. 

view in the home entertainment center. 20 embodiment, as shown in FIG. 9C, a microphone 
The DSS signal on coax cable 116 also contains data 1244, an earphone 1242, and an RF transceiver are included 
relating to television programming scheduling and closed i° remote control devices 124, providing a cordless- 
caption information. In some video broadcast services, the telephone functionahty, with PC 118 being the base unit and 
closed caption information is contained in the vertical blank- ^^^^^ control 124 being the remote unit. In another such 
ing interval of video signals. This information is captured by 25 embodiment, as shown m HG. 10, a microphone 1244, a 
the receiver 316 and separated out from the video and audio speaker 1242, and an RF transceiver are mcluded m remote 
signals, and provided on the PCI bus to RAM 324 where it ^^o^^^l ^^^^^^ 1^^' providing a cordless-telephone 
is accessible to processor 310. It can also be .stored on any functionality, with PC 118 being the base unit and remote 
other storage device capable of storing text or other digital control 126 being the remote unit. Phone calls can be 
data. As shown in FIG. 8, the text is stored directly into a 30 received or imUatcd by activating a "phone" function by 
database 812 on RAM 324 or disk drive 332. In one pressing one or more of the control buttons on the phone, 
preferred embodiment, database 812 comprises flat files of such as simultaneously pressing buttons 922 and 928, which, 
the entire text provided by receiver 316. No organization is one embodiment, toggles function between TV and 
applied to it other than sequential as received. A search P^o^^' ^^'^^y automatically muting the audio of the TV 
engine 814 ninning on processor 310 accepts user queries 35 when phone function is desired. 

indicated at 816 in the form of key words. All standard A power switch is provided at 914 to provide power-on/ 

commercial database query functionahty, such as proximity functions for the monitor 122 and resume/rest for per- 

searching, query by example, wildcard letters, etc are appM- sonal computer 118. Channel control buttons 916 provide 

cable. Search engine 814 then applies the query to the the familiar televisionA^CR up and down channel control 

database 812 and supplies the results back through the VGA 40 functions. Volume controls 918 are also provided, as is the 

card 318 for display. The data is preferably formatted as standard number keypad in television remote controls indi- 

specified by the user, most likely in terms of the title of the eated generally at 920. Further provided are mute button 

program, the time that it will be on, and the channel that it 922, channel recall 924, FAV (favorite channel or menu) 

will be on. Further information, such as descriptions of the button 926 and TV button 928, which serves to cycle the 

program, and at least partial credits including director and 45 display through full screen display of a television program, 

actors may also be .specified to be provided by the user. to putting it in a window, to hiding it completely. An 

Closed caption information is stored separately from the additional fiinction set control button 930 is used to select 

programming information and may be queried separately. functions provided by an operating system beyond those 

Where a separate data channel contains all the closed normally provided today. Much as the "Ctrl" and "Alt" keys 

caption information for the channels containing video 50 are used to select different functions, die function set button 

information, it is easy to store the closed caption information ^ similarly used on the hand held remote 124 to select 

for all the channels. However, if it is required to decode each the functions defined by the operating system. FAV button 

video MPEG channel, then only the closed caption infor- 926 may be unique to each famUy member, and comprise a 

mation from one channel at a time is stored. An auto surf listing of the users favorite television programs, games, 

function cycles through desired channels, picking up por- 55 computer application programs, home pages on internet, or 

tions of closed caption information, which can then also be other interfaces into the electronic world, 

searched. This is very useful when boking for current event Hand held remote 124 also contains RF generating cir- 

type programming. Perhaps a user is interested in a particu- cuitry coupled to all the keys and pointing devices for 

lar place, or when a particular feature on a desirable topic generating RF signals conesponding to the buttons pressed 

starts. Aquery to review all the cunrent and past mentions of 60 for reception by RF circuitry 324. The power of the RF 

the place or feature during live programming can quickly signal is adjustable via a thumbwheel indicated at 934, 

alert the user to broadcasts satisfying the query. Where which is coupled to further power adjusting circuitry shown 

closed caption is not supported, the sound track from video in FIG. 12. Power is provided by a standard 9 volt cell 936, 

is fed into a speech recognition program 820 running on or multiple double "A" batteries, accessible via a removable 

processor 310 which recognizes at least a few words from 65 panel 940, 

current television programming, and will improve with time Remote keyboard 126, shown in further detail in FIG. 10, 

and advancement in linguistic parsing. For now, only the is very simQar to a MF II keyboard, except that the numeric 
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key pad has been replaced with televisionA^CR like remote 
control buttons, and a touchpad indicated at 1010. In 
addition, it contains a pair of function set keys 1012 and 
1014 for invoking the same functions as button 930 on 
handheld remote 124. The television/CR buttons include a 
power button 1016, volume controls 1018, channel controls 
1020, TV/VCR button 1022, mute button 1024, a favorite 
channel/function button 1026 and a chaimel recall button 
1028. In addition, selection keys 1030 and 1032 are pro- 
vided to select function indicated by the cursor as controlled 
by touchpad 1010. Touchpad 1010 is integrated into the 
remote keyboard, and permits easy manipulation of the 
cursor by simply moving an object, such as a pen, stick or 
finger/finger nail across the pad in the desired direction. It 
can be useful for performing signatures to validate 
transactioas, or restrict access to files. By integrating touch- 
pad 1010 directly in the remote keyboard 126, there are no 
external connections, or sliding drawers to contend with, 
which could easily become clogged with grease, butter, 
sugar or any of the other messy things people eat while being 
entertained in a family entertainment center. The portion of 
the keyboard containing the television/VCR remote controls 
is preferably sealed, and impervious to being affected by 
such foods and drinks as are commonly found in a family 
room. Since the keyboard is more likely to be heavily used, 
a higher number of double "A" batteries are used. Four to 
eight provide a suitable length of operation. They may be 
rechargeable, and an external power jack 1042 is provided to 
allow the keyboard to be plugged into standard electrical 
utility power supplies. 

As with the handheld remote 124, the keyboard remote 
126 comprises RF generating circuitry 1040 to provide RF 
signals for reception by RF circuitry 324 in personal com- 
puter 118. RF circuitry 1040 also adds on a keyboard 
identifier with the signals it transmits, whidi identifies each 
keystroke as originating from the keyboard. In one 
embodiment, it is a set of bits that is unique to the remote 
device. This helps prevent inadvertent interference from 
other owners of similar home entertainment systems &om 
inadvertently controlling the users system. In another 
embodiment, the frequency is shifted slightly from that 
emitted by the handheld remote, and RF circuitry 324 
detects the bits, or the frequency shift and identifies the 
keystrokes as originating from either the handheld remote, 
or the remote keyboard which is associated with the system. 
In yet a further preferred embodiment, multiple remotes are 
provided, each with its own identifying frequency or code, 
including joysticks for controlling games. In this manner, 
each individual in the room can be controlling their appli- 
cation or program in a window, or be playing different parts 
in a game. 

Since all remotes would be sending the same signals to 
represent the same functions, the drivers for such remotes 
running on processor 310 need not differ. They need only be 
designed to handle multiple different sources of the 
keystrokes, button strokes, mouse, stick or touchpad signals. 

A high level flowchart showing how commands issued 
from different remote control devices are interpreted by 
processor 310 to control different applications is shown in 
FIG. llo. When an application is started in a Windows 3.11 
or 95 environment, it is initialized as shown at 1110 to be 
associated with a particular remote. The keys or buttons 
from such remote are identified in groups of either "key- 
board" or "TV" or "game" type keys. Game type keys would 
be those associated with the stick, trackball or mouse type of 
pointing devices. Thus, an application could be associated 
with game keys from the handheld remote for one player of 
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a game, and game keys from the keyboard remote for a 
second player. Further remotes, or different groups from a 
remote could be used for further players. When RF circuitry 
324 receives signals from a remote, it identifies the 

5 command, such as what key was pressed, and which remote 
device it came from to processor 310 at step 1112. Processor 
310 then identifies the application in a window to which is 
should be applied. If it is a presentation type of command, 
such as enlarging a window or opening a window as 
determined at 1116, the command is routed to the window 
manager for execution at 1118. If not, it is executed on the 
application that the group it is associated with was initialized 
to at step 1110. In further prefened embodiments, individual 
keys are associated with applications, however, at least one 

J 5 group or key is always associated with the underlying 
operating system to prevent a user from being locked out of 
other applications. One further use of the above system is to 
assign TVA'^CR controls to television programming associ- 
ated with a window. In this manner, no cursor need be 

2Q present in the window, blocking the television programming 
in order to perform channel selection. In addition, if some- 
one else is watching a program in a different window, their 
channel selection controls will only affect their window. 
A block diagram in FIG. lib represents tables formed by 

25 a program manager to associate remote control devices and 
the input devices on the remote control devices to programs. 
Programs, as used herein refer to computer appUcation 
programs and television programs, both of which are con- 
trollable by remote control devices. A first program 1122 is 

30 associated with a first remote controller, Rl, whose input 
devices Dl and D2 control the first program. Dl and D2 
correspond to the alphanumeric keys, such as a computer 
keyboard keyset, or subset thereof, or a cursor control 
device, or even the television control pad previously dis- 

35 cussed. Second, third arid fourth programs 1124, 1126, and 
1128 are also associated with remote control devices, and in 
some instances multiple remote control devices. Fourth 
program 1128 is controlled by input device sets Dl and D2 
of remote Rl, and Dl and D2 of tlie second remote R2. The 

40 low level granularity of associating sets of keys to applica- 
tions provides great flexibility for a multi-user home enter- 
tainment system. 

In a further embodiment, FM earphone headsets are 
provided to enable each person to hear only the sound that 

45 is associated with their own window of programming. The 
sound associated with each program is either assigned to one 
of several standard FM frequencies and broadcast in low 
power, much like that in a drive-in movie theater, and each 
headset is tunable to the frequencies broadcast. In another 

50 embodiment, each headset is tuned to a different single 
frequency, and the user selects the windows whose sound 
will be broadcast on which frequencies. The top most 
window in such a set of windows wHl have its audio so 
broadcast. 

55 Further detail of RF circuitry in the remote control 
devices is shown in FIG. 12. An input device, comprising the 
keyboard or hand held remote is indicated at 1210. When a 
key, touchpad command, trackball etc command is 
activated, it is provided to a decoder 1212, which decodes 

60 the command into a signal representative of the command to 
be transmitted. It also adds a header and check bits to the 
signal to be transmitted, indicating a unique identification of 
the remote. The identification in one embodiment is a digital 
signal which is unique for each remote control for one 

65 system and stored on an EE-PROM, while in a further 
embodiment, the code is an eight bit, or a 16 bit code which 
results in over 64,000 different combinations, making it 
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unlikely that neighbors within range will have remotes with transmission frequency, which is set, in one embodiment, by 

codes that will control a user's system. The unique identifier a DIP switch 1240. 

may also be represented by selecting a different frequency another embodiment, the remote control devices are 

for each remote control device. TTie system uses this unique ^ ^ "speakerphone - a hands-free intercom-like con- 

idcntification as described above to detcrmme which pro- 5 section to the telephone system. In conjunction with the 

gram should be affected by the particular command issued ^^^^^ j^^^^ ^^^^^.^^ 324 ^^^^^^^^^ 

from the particular remote that issued it. ^^^^^^^ ^ ^ ^^^^^^ equivalent to the base unit of a 

The Decoder 1212 provides a decoded signal to an FM cordless phone. Aspeaker 1242 on the remote control device 

signal source and modulator 1214, which in one embodi- ^ ^^pj^d to the receiver 1226, which receives RF voice 

ment generates a desired RF signal in the 900 megahertz 10 from the RF circuitry 324, and provides the received sound, 

region of the electromagnetic spectrum. This signal is pro- ^ microphoDe 1244 is coupled to the decoder 1212 for 

vided to a power amplifier 1216, which ampHfies the RF transmitting sound created by the user. Receiver 1226 and 

signal and provides it to an antenna 1218 for transmission to decoder 1212 operate in conjunction as the handset of a 

the system. The power amplifier 1216 consumes most of the standard cordless phone. In a further embodiment, the 

power in the remote control device. Apotentiometer 1222 IS 15 earphone headsets are used in place of the speakers for 

provided to reduce the gain of the amplifier so that it is not privacy. In one embodiment, a headset jack is provided in 
always amphfymg the signals at the highest power level. remote control device as part of the block indicating 

Since users wUl vary the distance they are from the system, speaker 1242 and standard headsets may be used, 
there is no need to always transmit at the maximum power n/i . 1 l h 

I , • 1 . 4U * *u J- * .u When the user receives a telephone call, a message 

level. If a user is close to the system, the user may adjust the 20 *u j- 1 -^u .u :•. 4:*u n* 

1 1 J J L • .1. i_ L 1 appears on the display with the identity of the calling source 

power level downward by turning the thumb wheel on the ■/ n tt^ - • i j u *u * 1 il • 1 * j 

^ • ,u * * J - 7- *u * if caUer ID is provided by the telephone service selected, 

remote in the appropnate direction until the system no « • * _r - . -1 j . ^ . « 

I • *u * - ■ T u J- * *u This allows easy interface into available databases to pull 

longer receives the transmissions. In one embodiment, the n • ^ u . h . j . 

. ^ .a * * • 1 * J up further miormation about the caller stored on the system, 

receiver in the system detects the signal strength received, / , .t. . • j . ^^ ^ 

. . J • 1 r ju 1 J* 1 * • ^ A key 931 on the remote is used to answer the call. The 

and provides visual feedback on the display to assist the user 75 1 j • . i_ -.l .i_ j j- 

. . 1 1 * 1 1 i. . keypad is used to enter numbers, with the modem providing 

m setting the power level to a level where no errors in . j r^rj^Mr /j 1 . 1 r \ . 

' • J, , A 1 1-11. 1. standard DTMF (dual-tone, multiple-frequency) tones, 

transmission due to low power signals arc ukely to result. ^ r *i jy 

Such signal power level detectors are well known in the art^ ^h^ remotes 124 and 126 also contain jacks 942 and 1044 

and one example is shown in U.S. Pat. No. 5,193,210. In a ^^^^ controller input. A standard personal computer 

further embodiment, the RF receiver 324 also comprises an 30 ^^^^ P°^^ provided, or in conjunction with the RF 

RF transmitter, and provides an RF signal representative of transceiver capability of the remote control devices, a bidi- 

the power level back to the remote, which is received by a rectional digital port is provided firom jacks 942 and 1044. 

receiver antenna 1224. Antenna 1224 is coupled to a One example of the advantages of having a full function 

receiver/demodulator/decoder 1226 which decodes the sig- computer operating in conjunction with broadband video is 

nal and provides a digital signal representative of transmit- 35 that it opens up the power of a personal computer to control 

ted signal strength back to a power control circuit 1228. the video streams and advanced user functions. The interface 

Power control circuit 1228 is coupled to the potentiometer to the broadband video is much more user friendly. In FIG. 

1222 for adjustment of the gain of power amplifier 1216 13, one example is shown, with a standard television like 

based on the signal strength feedback from the system. schedule indicated generally at 1310. It comprises a timeline 

Power control circuitry 1228 is also coupled to the input 40 across the top, starting at 8 PM and progressing to midnight. 

device, to sense when commands are entered. It is also Four channels, A, B, C and D are shown, but many more 

coupled to the other components to control when they are may be available. Other programs, such as games and word 

supplied power. During touchpad and trackball operation, processors which may be selected in standard double mouse 

power is supplied continuously to all the electronics. click fashion are also shown. Both the time frames and the 

However, after a predetermined period of time, approxi- 45 number of channels shown may be modified by the user 

mately 1 second, with no further commands being sensed, enlarging the window using standard Windows based navi- 

the power control circuitry 1228 cuts off power to most of gation techniques. Multiple cells, or programs are shown on 

the other circuitry, and only turns it back on within miUi- each channel, and are represented as a sufSx of the channel 

seconds when activity on the input device 1210 is detected. letter for discussion herein. In actuality, program titles and 

When other circuitry is powered off, the power control 50 descriptions appear be inserted in each cell. By clicking on 

circuit remains active, along with the receiver 1226. The a cell with the right mouse button, further details appear in 

power control circuit 1228 buffers commands until the other an expanded version of the cell. 

circuitry is ready to process the commands. Since it turns Several icons are tied to functions controlled by the 

back on quickly, there is no perceptible delay by the user. system. A record icon 1320 is tied to either a separate video 

In a further embodiment, each input device command 5S cassette recorder, the tape drive, or the disk drive to record 

transmitted is acknowledged by the system with an echo of selected channels. A program cell may be indicated for 

the command. When no acknowledgement is received, the recording by dragging the cell with a mouse control and 

power control circuitry 1228 instructs the decoder to send dropping it onto the record icon. Similarly, a reminder may 

the signal again, while increasing the power level until the be set by dropping a program cell onto a remind icon 1322. 

system properly acknowledges the command. All other 60 If a pay per view program is desired, one simply drags the 

commands are buffered in the power control circuitry until program cell, which is perhaps outlined in green, over on top 

successful transmission of the command, whereupon they of a buy icon 1324. The buy icon is also used when viewing 

are transmitted at the new adjusted power level. In one a home shopping channel, or a catalog in a similar manner, 

embodiment, the times for rebroadcast are randomly chosen, To view a primary program, a user either double clicks on a 

and prevented if the receiver 1226 detects transmissions 65 cell, or drags a cell to a view icon 1326 and drops it there, 

from another remote control device or the system to prevent To place a program into a picture in picture format, a user 

interference. This is not done if each remote has its own drags a cell onto a PIP icon 1328. The picture in picture 
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window may then be resized like any other window, or 
moved to another area of the display. All the icons may also 
be arranged in an L-shape surrounding a primary channel 
being viewed so that the icons do not interfere with the video 
images being displayed from the primary channel. S 

In one embodiment, each remote control device controls 
a difEerent cursor, shown as Rl and R2 on the screen in FIG. 
13. When the cursor is used to select a program, it becomes 
the primary controller for that program. The keys on the 
remote are automatically mapped into the program selected, 
The keyboard however, retains control of the task list, and is 
capable of selecting a program and becoming the primary 
control device for that program to the exclusion of the hand 
held remote control device. 

In FIG, 13, icons El and E2 represent remote earphones. 
The personal computer sound card 320 also contains a multi 
frequency FM transmitter 646 with antenna 648, and has the 
capability to generate separate sound tracks for each window 
being displayed on the monitor. It assigns each to one or 
more sets of earphones and transmits a local FM signal or 
broadcast IR or RF which is received and played by the 
earphones set to the right channel. The earphones have 
tuning circuitry that allows them to be set to a desired 
channel, or they may be fixed to different frequencies. The 
user drags the appropriate icon over to the program having 
the desired sound track, or to the remote that the user is 
controlling and drops it. If dropped on a program, the sound 
card transmits the sound for that application on the fre- 
quency associated with the earphones which are tuned to 
that frequency. If it is dropped on a remote control device, 
the top window associated with that remote has the sound 
associated with it transmitted. 

A first screen display provided on monitor 122 to users is 
shown in block diagram form in FIG. 14a. The display 
comprises a set of icons which are tied to underlying 
functions in a Microsoft Windows95 or down level version 
operating environment. This front end is specifically 
designed to be a replacement shell for the normal Windows 
operating environment to make it user friendly to a family. 
It acts as an application manager, allowing the user to launch 
other applications and utiUties from within it. The front end 
is organized into the following areas, each of which leads to 
further menus: Entertainment, Information Services, 
Productivity, and Logon/Help/Configuration controls. The 
front end utilizes Win32c application program interfaces, 
and operates both as a shell and as a stand-alone application. 
It-supports drag and drop and is Win95 logo compliant. 

Further icons on the first screen comprise a logon icon for 
bringing up a dialog box asking for the user name and 50 
password and a help icon for bringing up a context sensitive 
help engine with a data file which is related to the screen 
where the help icon was selected. The dialog box for the 
logon contains an option for a default, or family logon which 
may not require a password. 55 

The front end splits the integrated video processing, audio 
processing and data processing functionality of the enter- 
tainment system into different areas of similar functionality 
as show in the block diagram of FIG. 14b, comprising an 
entertainment icon 1410, an information services icon 1412 60 
and a personal productivity icon 1414. Each of these icons, ^ 
when activated by clicking, or from a task list invoke further 
menus. An entertainment menu in a window on the monitor 
is shown in FIG. 14c, comprising selections such as 
Microsoft Home Theater, CD audio, Digital Video, IR 65 
Blaster and Games, all of which may be launched from this 
window. The Games icon provides a user configurable 



games menu, which has the capability of being user aware, 
provided the user identified himseff or herself at login. The 
person logged on is also noted at the bottom of the window. 
Each user is then above to have their favorite games listed 
when they are logged in. A home icon or control button is 
active, and takes the user back to the main menu. Help 
controls are also active, and take the user to context sensitive 
system and help information. 

The Information Services icon 1412 leads to a further 
Information Services Menu as shown in FIG. 14d. Many 
commercially available information services arc launchable, 
as well as telephony related functions tied to the modem, 
such as voice messages, fax viewing and mail readers. 

The Personal Productivity icon 1414 leads to a Personal 
Productivity menu in FIG. 14e, where personal productivity 
software is launchable. While shown as a text based list, the 
applications may also be represented by icons. 

A configuration menu is shown in FIG. 14/ and is found 
through the first screen display. Cancel is the active button 
in this menu due to the potential to adversely affect the look 
and operation of the entertainment system. A user can 
change the front end to essentially a computer program 
based interface, change the clock of the system, browse the 
secondary storage for other applications which can be 
dragged and dropped onto different menus, and remove 
applications from different menus. 

One embodiment, implemented on a circuit card or cards 
for providing video conferencing via a public switched 
telephone network is shown generally at 1510 in FIG. 15. 
Broken line block 1511 implements an industry standard, 
such as the proposed ITU-T (International Telecommunica- 
tions Union-Telecommunications) standard, and each ele- 
ment described hereinafter within block 1511 implements 
the standards that are identified in the element block. 

Input/output devices comprising a microphone 1512 and 
speaker 1514 are coupled to a signal converter 1516. Con- 
verter 1516 converts signals from the microphone to digital 
signals, and digital signals to analog speakers for driving the 
speaker 1514. Converter 1516 is coupled to an echo can- 
celling device 1518 for reducing feedback between the 
speaker and microphone. An audio coder/decoder 1520 is 
coupled to both the cancelling device 1518 and converter 
1516, and to a delay circuit 1522, which in turn is coupled 
to a multiplexor/demultiplexor 1524 for processing the 
audio signals. Multiplexor 1524 is in turn coupled to a 
modem 1526, which has capability for both sending and 
receiving data on a public switched telephone network 
("PSTN*") indicated at 1528 in either analog (such as a 
modem connected to an analog "POTS" or plain old tele- 
phone system) or digital (such as a digital ISDN connection) 
form. 

A video camera 1532 (which can be a stand-alone video 
camera, a commercially available camcorder, or other imag- 
ing device) is coupled to suitable video inputs on back panel 
710, and is used to provide a video feed to a color space 
convertor/graphics display module 1535, which provides a 
further video signal to a video coder/decoder 1536, which is 
coupled to the multiplexor 1524. Video signals received 
from the camera are compressed by the codec (coder/ 
decoder) 1536, and then transmitted over the telephone 
network by modem 1526. Video signals received from the 
network by modem 1526 are demultiplexed, decompressed 
and turned into signals (in one embodiment, into VGA 
signals) for display on a monitor. In addition to providing the 
ability to perform video conferencing with other compatible 
systems over a telephone network, several data-exchange 
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protocols are supported at a data converter 1540, which is 
coupled between the multiplexor 1524 and a data storage 
device 1542 containing data generated by a user application. 
A system control icon 1544 represents the ability of the 
operating system of a computer, such as the computer 5 
comprising the home entertainment system, to control the 
elements of the video conferencing circuitry. System control 
1544 is coupled to a system control block 1546, which 
implements standard H.246 and in turn is coupled to both the 
multiplexor 1524 and modem 1526 to provide operator 
control thereof 

A further embodiment of a video conferencing aspect of 
the home entertainment system is shown in FIG. 16 gener- 
ally at 1610, Common components of the home entertain- 
ment system are numbered the same as in previous figures. 15 
In this implementation, a plain old telephone system 
("POTS") connection 1612 (which is alternatively a digital 
connection such as ISDN into the PSTN) can also is used for 
the video, sound and data signal transmission. Other users to 
be connected by video conference arc represented at 1614. 
A camcorder 1616 (which can be a stand-alone video 
camera, a commercially available camcorder, or other imag- 
ing device) is used to provide the audioA^ideo feed via the 
back panel inputs 710, where the video and audio are then 
provided to the sound 320 and converter 318 cards for 
digitization. The digitized signals are then sent through the 
system bus to the modem 322 for transmission. Received 
signals via the modem are sent to the CPU, sound card, and 
video card for decompression and/or playing on monitor 122 
and/or a stereo/speaker combination 1620. Elements indi- 
cated with broken lines, are advanced features which are 
easily implementable. They include a voice capability 
coupled to the sound card 320 and modem 322 for providing 
a separate voice channel when video conferencing is not 
desired. A set of amplified speakers are indicated at 1624 
which are driven direcdy by the sound card 320 with no need 
for independent amplification. A digital camera with micro- 
phone indicated at 1628 is coupled directly to a digital signal 
processor (DSP) with mixing and decoding functions indi- 
cated at 1630. The DSP 1630 is coupled directly to the 
system bus 312. Finally, a video cassette recorder 1632 is 
coupled to the converter card 318 for recording. 

WhUe the system has been described in terms of a 
personal computer, it is easily modified to encompass a 
settop box version, where all the circuitry is integrated into 
one or two cards in a box designed to sit on top of a 
television having VGA input. In another version, all the 
circuitry is included inside of the television chassis. 

In one embodiment, full multi-media signal sourdng and 
destinationing of audio/video/digital-data (ANI/D) broad- 
casts is provided for. Referring to FIG. 1, one embodiment 
of signal 116 from satellite dish 114 provides digital ANID 
signals from such sources as DirectTV or Primestar. In 
another such embodiment, signal 116 provides analog AN 
such as NTSC antenna signals. In another such embodiment, 55 
signal 157 from camera 156 provides analog AA^ such as 
NTSC audio/video signals. In further embodiments, signal 
175 from cable source 174 provides analog and/or digital 
ANV/D. I further such embodiments, signal 163 from PSTN 
162 provides data or phone signals such as ISDN or POTS 60 
signals. In one set of such embodiments, computer 118 is 
programmed to automatically record analog signals, such as 
television programming, onto recordable media, such as 
video tape, in VCR 172 coupled to cable 173. In another 
such set of such embodiments, computer 118 is programmed 65 
to automatically record digital signals, such as digital tele- 
vision programming or CD-ROM-type audio, onto record- 
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able media, such as recordable compact disks, in CD juke- 
box 168 coupled to cable 169. CD jukebox 168 also plays 
CDs or CDROMS for use elsewhere. In another such 
embodiment, signals are sent to stereo-surround sound sys- 
tem 158 for audio output to one or more speakers 160, and 
on cable 151 to TV 150. In one such embodiment, earphones 
154 on cable 155 and gamepad 152 on cable 153 provide 
additional input/output through remote control 126. Home 
network 164 is "smart wiring*' used to transmit data and 
control within the home, coupled by cable 165 to computer 
118. VideoBlaster 170 provides video -signal processing on 
cable/connector 171. Cables 175, 116, 163, 157, 151, 173, 
171, 169, 155, and 153 can be wired coupling or wireless 
(such as RF or IR signals without v/hos). 

It is to be understood that the above description is 
intended to be illustrative, and not restrictive. Many other 
embodiments will be apparent to those of skill in the art 
upon reviewing the above description. The scope of the 
invention should, therefore, be determined with reference to 
the appended claims, along with the full scope of equivalents 
to which such claims are entitled. 

What is claimed is: 

1. An electronic card for a system, the card comprising: 
a receiver that receives an encoded digital video signal 

from a source external to the system; 
circuitry that identifies a plurality of remote devices based 
on unique respective frequencies of the plurality of 
remote devices and sends identifications of the plurality 
of remote devices to a processor connected to the 
receiver: 

a decoder coupled to the receiver that receives the 
encoded digital video signal from the receiver and 
decodes the signal into a decoded digital video signal; 

a video driver coupled to the decoder that receives the 
decoded digital video signal and converts the decoded 
video signal into an analog signal suitable for display 
on a data quahty monitor. 

2. An information handling system, comprising: 
a video card; 

a receiver on the video card that receives a compressed 
digital video signal from a source external to the 
system; 

circuitry that identifies a plurality of remote devices based 
on unique respective frequencies of the plurality of 
remote devices and sends identifications of the plurality 
of remote devices to a processor connected to the 
receiver: 

a decompressor on the video card coupled to the receiver 
that receives the compressed digital video signal from 
the receiver and decompresses the signal into a decom- 
pressed digital video signal; 

a video driver on the video card coupled to the decom- 
pressor that receives the decompressed digital video 
signal and converts the decompressed video signal into 
a data quality analog signal suitable for display on a 
data quality monitor. 

3. An information handling system, comprising: 
a computer having a bus; 

a receiver coupled to the bus for receiving a compressed 
digital video signal from a source external to the 
system; 

circuitry that identifies a plurality of remote devices based 
on unique respective frequencies of the plurality of 
remote devices and sends identifications of the plurality 
of remote devices to a processor connected to the 

. receiver; 
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a decompressor coupled to the bus for receiving the 
compressed digital video signal from the receiver and 
decompressing the signal into a decompressed digital 
video signal; 

a video driver coupled to the bus for receiving the 
decompressed digital video signal and converting the 

• decompressed video signal into data quality analog 
signals for display on a data quality monitor. 

4. A system, comprising: 

a personal computer having a processor, a main memory, 
a secondary storage device, and a bus for connecting 
the processor, the main memory and the secondary 
storage device and that receives signals from multiple 
circuits; 

circuitry that identifies a plurality of remote devices based 
on unique respective frequencies of the plurality of 
remote devices and sends identifications of the plurality 
of remote devices to the processor: 

a tuner for receiving a digital video broadcast signal and 
tuning the signal into a digital video signal; 

a monitor driver coupled to the bus that receives digital 
video signal and converts it into data quality analog 
signals suitable for display on a data quality monitor 
having a resolution of at least 640 by 480 pixels. 

5. The system of claim 4 wherein the bus is a personal 
computer standard PCI bus, allowing video signals to be 
processed by all the devices attached to the PCI bus. 

6. The system of claim 5 wherein the main memory is 
coupled to the bus, and provides memory storage for: 

a fifo memory buffer, and 

a buffer controller for controlling the buffer to store digital 
video signals, and to provide the buffered digital video 
signals to a decompressor in response to the system 
controller. 

7. The system of claim 4 wherein the digital video 
broadcast signal is compressed in accordance with MPEG 
standards, and the system further comprises an MPEG 
decompression circuit. 

8. A system, comprising: 

a system controller for receiving user input to control 
selected portions of the system; 

a receiver coupled to an antenna, for receiving a com- 
pressed digital video signal broadcast from a satellite; 

circuitry that identifies a plurality of remote devices based 
on unique respective frequencies of the plurality of 
remote devices and sends identifications of the plurality 
of remote devices to a processor connected to the 
receiver « 

a tuner, coupled to the receiver and the controller for 
selecting at least one channel of said compressed digital 
video signal in response to the controller; 

a decompressor, coupled to the tuner for receiving a 
channel of the compressed digital video signal and 
decompressing the compressed digital video signal into 
a decompressed digital video signal; 

a converter, coupled to the decompressor for receiving the 
decompressed digital video signal and converting the 
decompressed video signal data quality analog signals 
having a resolution of at least 640 by 480 pixels. 
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9. The system of claim 8 and further comprising: 

a fifo memory buffer coupled to the tuner and 
decompressor, and 

a buffer controller for storing compressed digital video 
signals in said buffer, wherein said buffer controller 
causes the buffer to provide the buffered compressed 
digital video signals to the decompressor in response to 
the system controller. 

10. The system of claim 8 wherein the compressed digital 
video broadcast signal is compressed in accordance with 
MPEG standards, and the decompressor comprises an 
MPEG decompression circuit. 

11. The system of claim 8 and further comprising an audio 
processing circuit coupled to the converter for receiving 
decompressed audio data encoded in the digital video signal 
and providing an output suitable for driving speakers. 

12. The system of claim 11 wherein the audio processing 
circuit further comprises an input for accepting signals from 
a microphone. 

13. The system of claim 11 wherein the audio processing 
circuit further comprises an input for accepting signals from 
audio CD players. 

14. The system of claim 11 wherein the audio processing 
circuit further comprises an FM synthesis circuit for syn- 
thesizing sound. 

15. The system of claim 11 wherein the audio processing 
circuit further comprises a wavetable synthesis circuit for 
synthesizing sound. 

16. The system of claim 11 wherein the audio processing 
circuit further comprises: 

an FM synthesis circuit for synthesizing sound 
a wavetable synthesis circuit for synthesizing sound; and 
a mixer, coupled to the FM synthesis circuit and to the 
wavetable synthesis circuit for mixing the sounds cre- 
ated by both and providing them to a line out. 

17. The system of claim 8, and further comprising: 

an NTSC tuner for tuning regular commercial broadcast 
television signals to provide a second video feed to the 
monitor driver. 

18. The system of claim 8, wherein all the elements 
therein are contained within a personal computer chassis. 

19. An information handling system capable of receiving 
compressed digital video signals broadcast from one or more 
satellites, the system comprising: 

a personal computer having 

a first circuit for receiving a compressed digital video 
signal broadcast from at least one satellite; 

a second circuit for decompressing the compressed digital 
video signal into a decompressed digital video signal; 

a third circuit for converting the decompressed video 
signal into data quality analog signals suitable for 
display on a data quality television capable of a reso- 
lution of at least 640 by 480 pixels, and 

a fourth circuit for identifying a plurality of remote 
devices based on unique respective frequencies of the 
plurality of remote devices and sending identifications 
of the plurality of remote devices to a processor con- 
nected to the first circuit. 
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